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The sample-to-sample fluctuations AFn of the free energy in the Sherrington-Kirkpatrick model 
are shown rigorously to be related to bond chaos. Via this connection, the fluctuations become 
analytically accessible by replica methods. The replica calculation for bond chaos shows that the 
exponent fi governing the growth of the fluctuations with system size N, AFn ~ N^, is bounded 
by n < |. 



The sample-to-sample fluctuations of the free energy 
in the mean-field Ising spin glass [l| are a long standing 
unsolved problem in spin glass physics. In addition to 
their intrinsic interest as a finite size effect in spin glasses, 
they are of fundamental importance for the physics of 
finite-dimensional spin glasses. It has been shown [2[ 
that the finite-size scaling of the free energy fluctuations 
AFn in the mean-field spin glass is equal to the scaling 
of the domain wall energy AFjjw i n finite dimensions 
d > 6, i.e. cx AF N cx AF DW cx L e , where N is 
the total system size and L its linear dimension (in the 
case of a finite dimensional system). This implies the 
relationship 9 — dfi between the domain wall exponent 
and the fluctuation exponent fi. This highly nontrivial 
equivalence between a mean-field quantity and a finite- 
dimensional quantity provides a strong test for replica 
field theory which was used in Ref.0 to derive this result. 

Chaos is also a very important aspect of spin glasses. 
Chaos refers to the property that an infinitesimal change 
of, for instance, the temperature or the bond strengths 
results in a complete change of the equilibrium state. 
Chaos was first suggested in the context of the droplet 
picture and finite dimensional spin glasses [3 [but has also 
been studied in the mean field model 0, W, a] • 

In this paper we derive a new and exact connection 
between the free energy fluctuations and the seemingly 
unrelated phenomenon of chaos. Such a connection has 
been suggested by Bouchaud et al. 0] as part of a heuris- 
tic argument to obtain the free energy fluctuations. Our 
results partly corroborate the argument but we will see 
that a crucial ingredient seems to be missing from it. In 
addition to making the heuristic argument precise, our 
results provide a new way to access the fluctuations an- 
alytically. The fluctuations are a subextensive quantity 
such that their calculation usually requires higher order 
terms in the loop expansion. These are, however, inacces- 
sible due to the massless modes present throughout the 
spin glass phase. Here we will show that it is sufficient to 
calculate chaos to zero loop order (which is possible) to 
obtain the fluctuations. We demonstrate this explicitly 
above and at the critical temperature but believe and 
present evidence that it also works in the low tempera- 
ture phase. 

The method we use to derive the connection between 
fluctuations and chaos is a variation of the interpolat- 



ing Hamiltonian method. Our approach is inspired by 
the work of Billoire [8] where a similar method was in- 
troduced to study the finite size corrections to the free 
energy numerically. In this paper, we will set up a general 
formalism which will be amenable to an analytical treat- 
ment and derive the upper bound fi < 4. The details of 
the calculation will be published elsewhere Q . 

Numerically, the sample-to-sample fluctuations in the 
mean-field model have been investigated extensively in 
the literature @, EE El EE EE El ■ In all of these cases 
the study was restricted to zero temperature. The fluc- 
tuation exponent appears to be /j, ~ 0.25, although other 
values of [i can not entirely be ruled out. This value of 
/j, is also supported by heuristic arguments put forward 
in [3, 0]- However, fi = \ would violate the relation 
9 = dfj, since the numerical results for 9 in high dimen- 
sions by Boettcher IE 3 §i ye f° r instance 9 = 1.1 ± 0.1 
for d = 6 while dfx = 1.5 for fi = 0.25. It is not entirely 
clear whether the exponent /i is the same at T — and 
at finite temperature. While it most likely is identical, 
this is very hard to check since it is difficult to calcu- 
late n numerically at any finite temperature. With the 
connection to chaos, however, it will be possible in the 
future to calculate [i at finite temperature by simulating 
chaos. Although temperature chaos is difficult to simu- 
late as it is a tiny effect, bond chaos, which is relevant 
here, is much stronger and is visible more easily [6|. 

Other values than 0.25 for \i have been put forward in 
the literature. Crisanti et al. Il7j] found, using a result 
at zero-loop order by Kondor [18j ]. that n = g. The ar- 
gument is however not entirely rigorous. Nevertheless, 
it has recently been argued by a combination of heuris- 
tic arguments and extensive numerical simulations at fi- 
nite temperature that fj, = -r is indeed correct [3- The 
bound ju < ~ derived here is compatible with this but, 
unfortunately, does not rule out fj, = i. 

Analytically, the free energy fluctuations of any disor- 
dered system can in principle be found with the replica 
method. Given the partition function Z of a system of 
size N, it can easily be shown that a Taylor expansion of 
log Z" in powers of n yields log Z™ = -n(3F N + ^ AF^ + 
• • • , where the overbar means the average over the disor- 
der, = 1/HbT is the inverse temperature and Fn is the 
average free energy at system size N. The dots indicate 
higher order cumulants. Using the replica formalism, one 
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can calculate Z n for integer n and try to continue the 
resulting expression to real (or, indeed, complex) n and 
isolate the coefficient of the second order term which rep- 
resents the fluctuations. In the case of the Ising spin glass 
this works very nicely above and at the critical temper- 
ature. It is straightforward to show with the standard 
replica formalism for the mean-field spin glass [2(| that 
in the high temperature phase (/3 < 1), where the sad- 
dle point is replica symmetric and its Hessian has only 
strictly positive eigenvalues, the fluctuations are 



1 



li 2 



pAFj, = -- log(l - n - + 0(1/N) (1) 

[Til l2ll ]. As the critical temperature T c is approached 
(J3 y 1/T C = 1), this expression diverges, which indi- 
cates that the fluctuations at the critical point must also 
diverge with N. A straightforward extension of the cal- 
culation in [2l[ shows that the fluctuations at the critical 
point are 



/3 2 AF 



N 



logJV + 0(l), 



(2) 



which does indeed diverge as N — > 00. 

Note that Eq. (JTJ) is a one- loop result. Eq. even re- 
quires reorganization of the perturbation series 2l| . We 
will see below that we can obtain precisely the same re- 
sults from a zero-loop order calculation of bond chaos. 

Interpolating Hamiltonians. In order to derive the 
connection between the fluctuations and chaos, we need 
to introduce the following interpolating Hamiltonians: 
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J ij SiSj 



(3) 



with N Ising spins Sj, < t < 1, r = 1, 2 and J^, 
, jff independent Gaussian random variables with 
unit variance. The parameter t interpolates between one 
spin glass system (t = 0) and a statistically independent, 
but otherwise identical one at t = 1. It is important to 
note that also for each other value of t the Hamiltonians 
describe a normal spin glass, the coupling constants being 
a/1 — tJij + v/t «//_• which are Gaussian random variables 
of unit variance. 

The partition functions of these Hamiltonians are 
Z ( t r) = Trexp(-PH{ r) ). Denoting the average over all 
coupling constants Jy , Jy and Jy by Ej, it is straight- 
forward to show that 

EjQogZP - logZ^) 2 = 2/3 2 AF 2 

(4) 

EjQogZW - logZ^XlogZ^ - log^ 2) ) = f3 2 AF 2 . 

(5) 

This gives us two distinct representations of the fluctu- 
ations. Using the idea from 22 1 to represent logZ± — 



(r) 

logZg ' by differentiating with respect to the interpola- 
tion parameter and immediately integrating again, the 
fluctuations can be written in two ways as 
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In [9(] it will be shown how to manipulate this expres- 
sion in order to arrive at the following Eqs. ([8]) and ([9]). 
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with h(t,r) = 2- ^=ML - ^)rJA% . Note that these 
equations are exact. The symbols qa b are overlaps be- 
tween independent replicas with different interpolation 
parameters, 



/, n 1 a,.t b 

lab(t,T) = ^Z^ s i s * 



(10) 



Although Eqs. © and ^ are formally very similar, there 
is an important difference. In Eq. 1(5)) replicas 1 and 2 
have Hamiltonian Til and replicas 3 and 4 have Hamil- 
tonian Ti^ . In Eq. on the other hand, replicas 1 

and 2 have Hamiltonian 7i[ while replicas 3 and 4 have 

(2) 

Hamiltonian Ti\ . The angular brackets (• • • ) denote the 
thermal average of a system of independent replicas with 
the appropriate Hamiltonians. 

The last important step is to employ the fact that for 
any given value of t, Tit represents a normal mean-field 
spin glass with Gaussian couplings just like any other. 
Consider Eq. ©. The overlap 913 between two replicas 
with different interpolation parameters is nothing but the 
overlap between two normal spin glasses with identical 
bonds (if t = t), uncorrected bonds (if t = 0,r = 1 or 
vice versa) or related, but not equal bonds (for anything 
in between). Similarly, for Eq. @ the overlap is between 
systems with equal bonds (t = r = 0), totally uncorre- 
cted bonds (t = 1 or r = 1) or correlated bonds (any- 
thing else). This shows the connection to bond chaos. 

The overlaps in Eqs. ([5]) and ^ thus do not de- 
pend on t and r separately but only on a measure 
of "distance" e between the two sets of bonds. We 
define e via the correlation between the bonds, i.e. 
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we set 

ij i 
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Eq. 
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rJi. 



and 



Ej{y/T=tJ K 



With these definitions, e = 



tVT^T for Eq. © 
means identical bonds and e = oo means totally uncor- 
related bonds. 

We can now make a change of variables under the in- 
tegrals in Eqs. §6§ and ((7| and eliminate, say, r in favor 
of e. The remaining integral over t can be carried out an- 
alytically and we get the two different exact expressions 
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deh{e)E J {{ql s -ql /k ){ a l s -ql 3 )) 



de 9l {e)[Ej{q^) y 



(11) 
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de/ 2 (e) J E; J ((g 2 3- g 2 4 )( g 2 3- g 2 3 )) 



deg 2 (e) I Ej(q 2 13 ) 



N 



(12) 



where 



A(e) = 



4e 2 arcsin ■ 



l + e 2 



5i( e ) = 



2 arcsin ■ 



(l + e 2 ) 3 / 2 



2elog(l + e 2 ) 
/2 ^ £ ) = (i + e 2) ■ 22(e) 



elog(l 



(l + e 2 ) 3 / 2 



(13) 
(14) 



By going over from t and r to e the distinction between 
the different choice of Hamiltonians in the two represen- 
tations of the fluctuations has disappeared and the over- 
laps as a function of e in both of these equations are the 
same. 

Note the minus sign in front of the first term in Eq. (fTTj) 
as opposed to the plus sign in Eq. (JT3J) . Since the func- 
tion /i(e) is nonnegative, the first term is indeed a neg- 
ative contribution. We conclude that the second term in 
Eq. (fTTj) is an upper bound for the fluctuations. 

Probability distribution of the overlap. If we had the 
disorder averaged probability distribution P e (q) to find 
the overlap q between two replicas with bond distance 
e, we could evaluate E(q 2 3 (e)). In order to evaluate 



E{(li3 ~ 9i4)(9i3 — 9I3)) we nee d the probability distri- 
bution P e 123 (qi3, (723) to simultaneously find qi 3 and (723, 
as well as the probability distribution -P e 1234 (914, 923) to 
find qi4 and (723- However, in this paper we will focus on 
Pe{q). 

The probability distribution P e (q) can be calculated 
approximately from large deviation statistics principles 
by considering two replicas with bonds and Jij(e) 
which are a bond distance e apart and constraining their 
overlap to a given value of q. The partition function 
Z ty j(q) of this combined system is 



Ze,j{q) = Trd[q- 



(15) 



The variables Si and ti are the spin variables of the two 
replicas. From this one gets the average free energy per 
spin Pfe(q) = -jjEjlogZ e j(q) and P e (q) is approxi- 
mated by 



P e (q)ttP?(q) 



-N/3 f € (q) 



J 1 dqe- N ^f^ 



(16) 



Averages over P°(q) will be denoted by [• ■ ■ ]o- 

A more precise discussion of the finite size effects and 
the relevance for "small" deviations will be given in 
Here we will show that P e °(g) is indeed the correct proba- 
bility distribution to use by demonstrating that it yields 
the exactly known results above and at the critical tem- 
perature and by comparing predictions in the spin glass 
phase with simulations from [f| (see below). 

Replica calculation. Temperature chaos in mean-field 
spin glasses has been treated in the literature How- 
ever, to the best of our knowledge, bond chaos has never 
been calculated and we will therefore present a brief 
sketch of our results here. Since these replica calcula- 
tions are fairly standard, we refer the reader to 0, Q 
for details. Repeating Rizzo's calculation 0] for the con- 
strained two-replica partition function from Eq. (fl"5|) but 
for bond chaos rather than temperature chaos, one ar- 
rives at the following truncated replica free energy 



Pfe( a ) = QPd 



P 2 d VPd 



6 2(1 - 2t' 



- + t / dzq 2 {z) + r' / dzp 2 (z) + ^ / dz {q\z)+p\z)) 



dz zq 3 (z) 



dz zp 2 {z)q(z) — w dz dz' ((q 2 (z) + p 2 (z))q(z') + 2p(z)q(z)p(z')) + 2wpd / dzp(z)q(z) 



(17) 



The parameters w and y are equal to 1 for the SK model temperature T c = l/(3 c = 1. The only reference to the 
and t = (f3 2 — l)/(2/3 2 ) is the distance from the critical 
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bond distance is contained in r 1 = (0 1 — y/1 + e 2 ) / (2/3 2 ). ^(x) 



-4/3 



(x — > oo). This behavior of F(x) is per- 



Three saddle point equations can be derived from this 
free energy by differentiating with respect to q(x), p(x) 
and pd- The function q(x) is the Parisi function for the 
overlap of the first replica with itself (the same function 
of course applies by symmetry to the overlap of the sec- 
ond replica with itself). The function p{x) describes the 
overlap between replica one and two. The parameter pd 
stems from the diagonal of the overlap matrix between 
replicas one and two and is a conjugate variable to the 
forced overlap q. 

Solving the saddle point equations is nontrivial and 
only possible in certain limiting cases. Deferring the de- 
tails to we summarize the results here. Above the 

critical temperature we find (3f e (q) = \ ( 1 



2 V' Vl+e 2 

0(q 4 ). With this we can calculate P e °(<z) according 
to Eq. (|16[) . Above the critical temperature, there 
is no replica symmetry breaking and the distributions 
P e 123 (<7i3, 923) and P e 1234 (<?i3, 924) factorize into a product 
of P°(g)'s. The expression Ej((q 2 3 - g 2 4 )(g 2 3 - gfs)) can 
thus be written as [g 4 ]o — [<7 2 ] 2 - The integrals in Eq. (fTSj) 
can then be evaluated exactly giving precisely the result 
from Eq. (TTJ). 

Exactly at the critical temperature there is still no 
replica symmetry breaking and the factorization of P e 123 
and P £ 1234 applies as above. We obtain P £ °(q) - e -Nwq 3 /6 
for e < A" 1 / 6 and P°(q) ~ e~ N ^^^ for AT -1 / 6 < e < 
1. These limiting cases are enough to calculate the lead- 
ing behavior of the integrals in Eq. (fT2")l and we get the 
same as in Eq. ([2]). 

Below the critical temperature, replica symmetry 
breaking does apply and we can not factorize P e and 
P £ 1234 . Although it has been shown in [H, Hi] how to 
break down these probability distributions, the results 
only apply for e = 0. We therefore concentrate on the 
second integral in Eq. (|f f \ which is an upper bound for 
the fluctuations. We find four regimes, 




e « N-V* 

N- 1 / 5 < e < 1 
otherwise 



(18) 



where are constants and /(e) is an (unimportant) 
function. Using these results we can calculate the leading 
behavior of J Q deEj(q 2 3 ) and obtain for the dominant 
contribution to the integral 



de gi {e)[q\ = N 1 / 2 dxT^-N 1 / 2 , 
Jo 

(19) 



Nf3 2 



where x = ev TV is a scaling variable and T{x) is a scaling 
function with the properties T[x) — > const, (x — > 0) and 



fectly consistent with the numerical results for [q]o pre- 
sented in Q. This is strong evidence that the finite size 
corrections are indeed irrelevant even in the low temper- 
ature phase. (Note x' — Ne 2 is used as a scaling variable 
in Q and the scaling of [q]o is investigated instead of [q 2 ]o 
as we do here. This is however only a trivial difference. 
Although they indicate in their scaling plot Fig. 1 a de- 

— 1/2 

crease proportional to 1' , visual inspection of that 



plot shows that a slower decrease 



-1/3 



is more likely 



which would coincide with the scaling of x 4 / 3 for J-(x) 
here.) 

Since Eq. (|19|) is an upper bound for the fluctuations, 
it follows that fi < j. 

Discussion. We have shown that there exists a deep 
and exact relation between the free energy fluctuations 
and chaos in spin glasses, Eqs. (fTTj) and (fT2| . A similar 
connection has been suggested by Bouchaud et al. in a 
heuristic argument 0- Briefly, the argument runs as 
follows. When the bonds are changed randomly by an 
amount of order 1/y/N, the ground state of the system 
changes and we get a new ground state energy. In order 
to obtain a truly independent new bond configuration, we 
must change the bonds by an amount of order one., i.e. we 
obtain a sequence of ~ V^V level crossings. Each of these 
contributes a random amount of order 1 to the change in 
ground state energy such that the final energy differs by 
an amount of order A 1 / 4 from the original ground state 
energy, i.e. /i = \. 

This argument corresponds precisely to the second 
term in Eq. (fTT|) . From Eq. (fT8|) we see that the over- 
lap does not change appreciably until e ~ A -1 / 2 (cor- 
responding to the statement that the ground state does 
not change up to that value of e), and the leading con- 
tribution to the fluctuations comes from tuning e from 
to O(l) and is proportional to TV 1 / 4 . There is, how- 
ever, the negative first term in Eq. (fTTj) which has no 
correspondence in the heuristic argument and which re- 
duces the size of the fluctuations and might decrease [i. 
We are currently unable to provide an intuitive explana- 
tion for this term. We note, however, that it is crucial 
and can not be ignored since in our second formulation, 
Eq. (fT2|) , the integral containing the four replica overlaps 
is the dominant term and is solely responsible for \i. A 
deeper understanding of these matters would be highly 
desirable. 
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